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(54) COMPOSITE IMAGE SYSTEM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a composite image system which 
enable persons at difference places to generate a composite image as if 
they gathered at the same place. 

SOLUTION: The composite image system comprises a portable 
telephone 1, a video telephone device 21, and a server 1 1 which is 
connected to them through a communication line. The video telephone 
device 21 may be a portable telephone set. The user of the portable 
telephone set 1 photographs himself by a CCD camera 8 and sends the 
image to the server 1 1. The server 1 1 puts images from the portable 
telephone set 1 and video telephone device 21 together and sends the 
composite image to them. Respective users view the composite image 
and send images of different looks, etc., again to the server 1 1, which 
composes and sends an image to the respective devices. 
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English Translation of Japanese Laid-Open Patent 
Publication No. 2002-176547 

[Detailed Description of the Invention] 
[0001] 

[Technical Field to Which the Invention Pertains] The 
invention relates to a composite image system for combining 
images of a plurality of persons located in remote areas through 
a communication line. 
[0002] 

[ Prior Art ] In recent years , there has been developed a machine 
{Print Club (registered trademark), Purikura (registered 
trademark) for short} out of which a picture immediately comes 
by a plurality persons getting together in front of the machine, 
inserting a coin into the machine, and performing a 
predetermined operation. On the other hand, conventionally, 
there is known a technique of creating a group picture by 
combining a plurality of pictures taken in advance . 
[0003] 

[Problems to be Solved by the Invention] However, in the 
aforementioned machine for a group picture, everyone needs to 
get together in front of the machine, and in addition, in a group 
picture created from a plurality of pictures, people's facial 
expressions cannot match one another, resulting in a picture 
appearing to lack uniformity. This invention is made in view 
of these circumstances, and its object is to provide a composite 
image system capable of creating a group picture which looks 
like a plurality of persons located in remote areas got together 
in the same place. 
[0004] 

[Means for Solving Problems] The invention is made to solve 
the foregoing problems, and the invention recited in claim 1 
is directed to a composite image system which comprises a 
plurality of telephone sets each having a photographing means 
and a display means; and a server connected to each of the 
plurality of telephone sets through a communication line, 
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characterized in that the plurality of telephone sets each send 
to the server an image taken with their respective photographing 
means and also display a composite image sent from the server 
on their respective display means, and the server combines 
images sent from the plurality of telephone sets and sends a 
composite image to each telephone set. 

[0005] In addition, the invention recited in claim 2 is 
characterized in that in the composite image system as recited 
in claim 1 each of the telephone sets sends to the server 
information about a combining position, and the server moves 
individual image positions based on information about a 
combining position sent from each of the telephone sets. 
[0006] In addition, the invention recited in claim 3 is 
characterized in that in the composite image system as recited 
in claim 1 or 2, the server combines images sent from the 
plurality of telephone sets with a background image stored in 
an internal storage means, and sends a composite image to each 
telephone set . 
[0007] 

[Embodiment of the Invention] Referring to the drawings, one 
embodiment of the invention will be described below. FIG. 1 
is a diagram illustrating a configuration of a composite image 
system according to the embodiment. In this drawing, numeral 
1 denotes a mobile telephone set. In the mobile telephone set 
1, 2 denotes a liquid crystal display, 3 denotes an off -hook 
button, 4 denotes an on-hook button, 5 denotes key switches such 
as a numeric keypad, and 6 denotes an antenna, and these 
configurations are the same as those of a normal mobile 
telephone set. 8 denotes a CCD (Charge Coupled Device) camera, 
and image data taken with the CCD camera 8 is sent from the 
antenna 6 . 

[0008] 11 denotes a server for creating a composite image, and 
is connected to the mobile telephone set 1 through a radio line . 
In the server 11, 12 denotes a display device and 13 denotes 
a control device. 21 denotes a video telephone set connected 
to the server 11 through a public line. In the video telephone 



2 



set 21, 22 denotes a handset, 23 denotes key switches, and 24 
and 25 denote an off -hook switch and an on-hook switch, 
respectively. In addition, 26 denotes a CCD camera and 27 
denotes a liquid crystal display. 

[0009] Next, the operation of the aforementioned composite 
image system will be described with reference to a flowchart 
shown in FIG. 2. Now, a description is made for the case where 
user A of the mobile telephone set 1 creates a composite image 
with user B of the video telephone set 21 located in a remote 
area. First, the user A allows a service selection menu to be 
displayed on the liquid crystal display 2 by operating the key 
switches 5 of the mobile telephone set 1, and selects "Purikura" 
from the displayed menu (step SA1). Next, a telephone number 
of the user B, a partner with whom Purikura is done, is inputted 
from the key switches 5, and then the off -hook switch 3 is turned 
on (step SA2). By this, a line between the mobile telephone 
set 1 and the server 11 is connected, and the telephone number 
of the user B is sent to the server 11. The server 11 receives 
this telephone number, establishes a call connection to the 
video telephone set 21, and notifies the user B that the user 
A is requesting for Purikura (step SCI). Next, the server 11 
sends a background list to the mobile telephone set 1 . 
[ 0010 ] The user B receives the aforementioned Purikura request 
from the user A (step SB1) , and sends to the server 11 an image 
taken with the CCD camera 26. On the other hand, the user A 
selects a background from the background list sent from the 
server 11, and notifies the server 11 of it (step SA3). 
Subsequently, the user A photographs him/herself with the CCD 
camera 8 and sends it to the server 11 (step SA4) . The server 
11 receives a notification about the background from the user 
A, reads background image data specified by the user A from 
database (step SC2) , and then combines the images sent from the 
users A and B with the background image (step SC3) . Next, the 
server 11 sends a composite image to the mobile telephone set 
1 of the user A and the video telephone set 21 of the user B 
(step SC4) . The mobile telephone set 1 and the video telephone 
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set 21 each display the composite image having been sent thereto 
(step SA5, step SB3 ) . 

[0011] If the user A considers, by viewing the displayed 
composite image, that he/she should change his/her facial 
expression, he/she photographs him/herself again with the CCD 
camera 8 and sends it to the server 11 (step SA4 ) . Similarly, 
if the user B also considers, by viewing the displayed composite 
image, that he/she should change his/her facial expression, 
he/she photographs him/herself again with the CCD camera 26 and 
sends it to the server 11 (step SB2). The server 11 receives 
these images, an<f then again, combines the images and sends a 
composite image to the users A and B (step SC4). Thereafter, 
until both of the users A and B are satisfied, the 
above -described steps are repeated. 

[0012] Next, the user A sends to the server 11 data which 
specifies a combining position of the image of him/herself and 
a front/back priority with the image of the user B (step SA6 ) . 
The server 11 combines the images with the image position 
changed based on the data sent from the user A (step SC3) , and 
sends a composite image to the user A (step SC4) . If the user 
A determines that both the facial expression and position are 
"OK", he/she sends an instruction of "OK" to the server 11 (step 
SA7 ) . Similarly, the user B sends to the server 11 data which 
specifies a combining position of the image of him/herself and 
a front/back priority with the image of the user A (step SB4 ) . 
The server 11 combines the images with the image position 
changed based on the data sent from the user B (step SC3) , and 
sends a composite image to the user B (step SC4 ) • If the user 
B determines that both the facial expression and position are 
n OK" , he/she sends an instruction of "OK" to the server 11 (step 
SB5) . 

[0013] The server having received the instruction of "OK" from 
the users A and B stores the composite image in the database 
(step SC5) . Then, in accordance with the instruction from the 
users A and B, the composite image is sent to the mobile telephone 
set 1 or the video telephone set 21, or the composite image is 
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printed out and sent to the user A or B (step SC6). 
[0014] As described above, according to the above-described 
embodiment, a composite image can be created such that the 
facial expression, the left /right position, the front /back 
position, or the like is changed in various ways, and thus it 
is possible to obtain a composite image (color print image) 
which looks like people located in remote areas were 
photographed in the same place. 

[0015] Note that it is also possible that a completed composite 
image attached with musical tone data is stored in database of 
the server 11, and if there is a request, the composite image 
along wit the musical tone data is sent. In this case, a mobile 
telephone set having received it displays the image on a liquid 
crystal display, and at the same time, reproduces the musical 
tone data and emits sound from a ringtone speaker. 
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SA1 SELECT - PURIKURA' FROM SERVICE SELECTION MENU 

SA2 INPUT TELEPHONE NUMBER OF B WITH WHOM PURIKURA IS DONE 

SA3 SELECT BACKGROUND FROM BACKGROUND LIST 

SA4 SEND IMAGE TAKEN WITH CAMERA TO SERVER 

SA6 SPECIFY COMBINING POSITION OF A AND FRONT/BACK PRIORITY WITH B 

SA7 SEND INSTRUCTION OF OK TO SERVER IF BOTH FACIAL EXPRESSION AND POSITION ARE OK 

SCI NOTIFY USER B OF BEING REQUESTED FOR PURIKURA 

SC2 EXTRACT BACKGROUND IMAGE DATA FROM DATABASE 

SC3 COMBINE BACKGROUND IMAGE AND IMAGES OF USERS A AND B 

SC4 SEND COMPOSITE IMAGE TO USERS A AND B 

SB1 RECEIVE PURIKURA REQUEST 

SB2 SEND IMAGE TAKEN WITH CAMERA TO SERVER 

SB 4 SPECIFY COMBINING POSITION OF B AND FRONT/BACK PRIORITY WITH A 

SB5 SEND INSTRUCTION OF OK TO SERVER IF BOTH FACIAL EXPRESSION AND POSITION ARE OK 

SC5 STORE COMPOSITE IMAGE 

SC6 IN ACCORDANCE WITH INSTRUCTION FROM USERS A AND B, SEND COMPOSITE IMAGE TO A AND B, 
PRINT OUT AND MAIL PICTURE TO A AND B, ETC. 



